People used to tell strange stories about that mansion